Audience Response System-Based Evaluation of Intelligibility of Children's Connected Speech - Validity, Reliability and Listener Differences.
Identifieur interne : 000075 ( Main/Exploration ); précédent : 000074; suivant : 000076Audience Response System-Based Evaluation of Intelligibility of Children's Connected Speech - Validity, Reliability and Listener Differences.
Auteurs : Sofia Strömbergsson [Suède] ; Katarina Holm [Suède] ; Jens Edlund [Suède] ; Tove Lagerberg [Suède] ; Anita Mcallister [Suède]Source :
- Journal of communication disorders [ 1873-7994 ]
Abstract
PURPOSE
We assessed audience response systems (ARS)-based evaluation of intelligibility, with a view to find a valid and reliable intelligibility measure that is accessible to non-trained participants. In addition, we investigated potential listener differences between pediatric speech and language pathologists (SLPs) and untrained adults.
METHOD
Sixteen one-minute samples of connected speech were compiled, collected from 14 children with a speech sound disorder (SSD) and two children with typical speech. 16 SLPs and 13 untrained adults participated in a series of ARS listening sessions, where they were fitted with headphones and hand controls, and instructed to click a button whenever they did not understand the child speaking. Listeners' button clicks were registered and, for each speech sample, totaled into an (un)intelligibility index. The proportion of syllables perceived correctly - based on orthographic listener transcripts - was used as a reference score of intelligibility.
RESULTS
The ARS-based intelligibility scores correlated strongly with the intelligibility reference score. Reliability was high across listener groups and weaker for single listeners. No significant difference was found between the evaluations of SLPs and untrained adults.
CONCLUSIONS
ARS-based evaluation offers a valid and reliable measure of intelligibility of particular value in research as a practical tool for collecting input from listeners without experience or knowledge of SSDs. We stress that the ARS design presupposes a listener panel, and that evaluations obtained from individual listeners are predictably inadequate in terms of reliability.
DOI: 10.1016/j.jcomdis.2020.106037
PubMed: 32846287
Affiliations:
Links toward previous steps (curation, corpus...)
Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Audience Response System-Based Evaluation of Intelligibility of Children's Connected Speech - Validity, Reliability and Listener Differences.</title><author><name sortKey="Strombergsson, Sofia" sort="Strombergsson, Sofia" uniqKey="Strombergsson S" first="Sofia" last="Strömbergsson">Sofia Strömbergsson</name><affiliation wicri:level="1"><nlm:affiliation>Division of Speech and Language Pathology, Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institutet (KI), SE-141 86 Stockholm, Sweden. Electronic address: sofia.strombergsson@ki.se.</nlm:affiliation><country xml:lang="fr">Suède</country><wicri:regionArea>Division of Speech and Language Pathology, Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institutet (KI), SE-141 86 Stockholm</wicri:regionArea><wicri:noRegion>SE-141 86 Stockholm</wicri:noRegion></affiliation></author><author><name sortKey="Holm, Katarina" sort="Holm, Katarina" uniqKey="Holm K" first="Katarina" last="Holm">Katarina Holm</name><affiliation wicri:level="1"><nlm:affiliation>Division of Speech and Language Pathology, Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institutet (KI), SE-141 86 Stockholm, Sweden.</nlm:affiliation><country xml:lang="fr">Suède</country><wicri:regionArea>Division of Speech and Language Pathology, Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institutet (KI), SE-141 86 Stockholm</wicri:regionArea><wicri:noRegion>SE-141 86 Stockholm</wicri:noRegion></affiliation></author><author><name sortKey="Edlund, Jens" sort="Edlund, Jens" uniqKey="Edlund J" first="Jens" last="Edlund">Jens Edlund</name><affiliation wicri:level="1"><nlm:affiliation>Speech Music & Hearing/Språkbanken Tal, KTH Royal Institute of Technology, SE-100 44 Stockholm, Sweden.</nlm:affiliation><country xml:lang="fr">Suède</country><wicri:regionArea>Speech Music & Hearing/Språkbanken Tal, KTH Royal Institute of Technology, SE-100 44 Stockholm</wicri:regionArea><wicri:noRegion>SE-100 44 Stockholm</wicri:noRegion></affiliation></author><author><name sortKey="Lagerberg, Tove" sort="Lagerberg, Tove" uniqKey="Lagerberg T" first="Tove" last="Lagerberg">Tove Lagerberg</name><affiliation wicri:level="1"><nlm:affiliation>Institute of Neuroscience and Physiology, Division of Speech and Language Pathology, University of Gothenburg, The Sahlgrenska Academy, Box 452, SE-405 30 Gothenburg, Sweden.</nlm:affiliation><country xml:lang="fr">Suède</country><wicri:regionArea>Institute of Neuroscience and Physiology, Division of Speech and Language Pathology, University of Gothenburg, The Sahlgrenska Academy, Box 452, SE-405 30 Gothenburg</wicri:regionArea><wicri:noRegion>SE-405 30 Gothenburg</wicri:noRegion></affiliation></author><author><name sortKey="Mcallister, Anita" sort="Mcallister, Anita" uniqKey="Mcallister A" first="Anita" last="Mcallister">Anita Mcallister</name><affiliation wicri:level="1"><nlm:affiliation>Division of Speech and Language Pathology, Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institutet (KI), SE-141 86 Stockholm, Sweden; Functional Area Speech and Language Pathology, Karolinska University Hospital, SE-141 86 Stockholm, Sweden.</nlm:affiliation><country xml:lang="fr">Suède</country><wicri:regionArea>Division of Speech and Language Pathology, Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institutet (KI), SE-141 86 Stockholm, Sweden; Functional Area Speech and Language Pathology, Karolinska University Hospital, SE-141 86 Stockholm</wicri:regionArea><wicri:noRegion>SE-141 86 Stockholm</wicri:noRegion></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">PubMed</idno><date when="2020">2020 Sep - Oct</date><idno type="RBID">pubmed:32846287</idno><idno type="pmid">32846287</idno><idno type="doi">10.1016/j.jcomdis.2020.106037</idno><idno type="wicri:Area/Main/Corpus">000183</idno><idno type="wicri:explorRef" wicri:stream="Main" wicri:step="Corpus" wicri:corpus="PubMed">000183</idno><idno type="wicri:Area/Main/Curation">000183</idno><idno type="wicri:explorRef" wicri:stream="Main" wicri:step="Curation">000183</idno><idno type="wicri:Area/Main/Exploration">000183</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en">Audience Response System-Based Evaluation of Intelligibility of Children's Connected Speech - Validity, Reliability and Listener Differences.</title><author><name sortKey="Strombergsson, Sofia" sort="Strombergsson, Sofia" uniqKey="Strombergsson S" first="Sofia" last="Strömbergsson">Sofia Strömbergsson</name><affiliation wicri:level="1"><nlm:affiliation>Division of Speech and Language Pathology, Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institutet (KI), SE-141 86 Stockholm, Sweden. Electronic address: sofia.strombergsson@ki.se.</nlm:affiliation><country xml:lang="fr">Suède</country><wicri:regionArea>Division of Speech and Language Pathology, Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institutet (KI), SE-141 86 Stockholm</wicri:regionArea><wicri:noRegion>SE-141 86 Stockholm</wicri:noRegion></affiliation></author><author><name sortKey="Holm, Katarina" sort="Holm, Katarina" uniqKey="Holm K" first="Katarina" last="Holm">Katarina Holm</name><affiliation wicri:level="1"><nlm:affiliation>Division of Speech and Language Pathology, Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institutet (KI), SE-141 86 Stockholm, Sweden.</nlm:affiliation><country xml:lang="fr">Suède</country><wicri:regionArea>Division of Speech and Language Pathology, Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institutet (KI), SE-141 86 Stockholm</wicri:regionArea><wicri:noRegion>SE-141 86 Stockholm</wicri:noRegion></affiliation></author><author><name sortKey="Edlund, Jens" sort="Edlund, Jens" uniqKey="Edlund J" first="Jens" last="Edlund">Jens Edlund</name><affiliation wicri:level="1"><nlm:affiliation>Speech Music & Hearing/Språkbanken Tal, KTH Royal Institute of Technology, SE-100 44 Stockholm, Sweden.</nlm:affiliation><country xml:lang="fr">Suède</country><wicri:regionArea>Speech Music & Hearing/Språkbanken Tal, KTH Royal Institute of Technology, SE-100 44 Stockholm</wicri:regionArea><wicri:noRegion>SE-100 44 Stockholm</wicri:noRegion></affiliation></author><author><name sortKey="Lagerberg, Tove" sort="Lagerberg, Tove" uniqKey="Lagerberg T" first="Tove" last="Lagerberg">Tove Lagerberg</name><affiliation wicri:level="1"><nlm:affiliation>Institute of Neuroscience and Physiology, Division of Speech and Language Pathology, University of Gothenburg, The Sahlgrenska Academy, Box 452, SE-405 30 Gothenburg, Sweden.</nlm:affiliation><country xml:lang="fr">Suède</country><wicri:regionArea>Institute of Neuroscience and Physiology, Division of Speech and Language Pathology, University of Gothenburg, The Sahlgrenska Academy, Box 452, SE-405 30 Gothenburg</wicri:regionArea><wicri:noRegion>SE-405 30 Gothenburg</wicri:noRegion></affiliation></author><author><name sortKey="Mcallister, Anita" sort="Mcallister, Anita" uniqKey="Mcallister A" first="Anita" last="Mcallister">Anita Mcallister</name><affiliation wicri:level="1"><nlm:affiliation>Division of Speech and Language Pathology, Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institutet (KI), SE-141 86 Stockholm, Sweden; Functional Area Speech and Language Pathology, Karolinska University Hospital, SE-141 86 Stockholm, Sweden.</nlm:affiliation><country xml:lang="fr">Suède</country><wicri:regionArea>Division of Speech and Language Pathology, Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institutet (KI), SE-141 86 Stockholm, Sweden; Functional Area Speech and Language Pathology, Karolinska University Hospital, SE-141 86 Stockholm</wicri:regionArea><wicri:noRegion>SE-141 86 Stockholm</wicri:noRegion></affiliation></author></analytic><series><title level="j">Journal of communication disorders</title><idno type="eISSN">1873-7994</idno></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en"><p><b>PURPOSE</b></p><p>We assessed audience response systems (ARS)-based evaluation of intelligibility, with a view to find a valid and reliable intelligibility measure that is accessible to non-trained participants. In addition, we investigated potential listener differences between pediatric speech and language pathologists (SLPs) and untrained adults.</p></div><div type="abstract" xml:lang="en"><p><b>METHOD</b></p><p>Sixteen one-minute samples of connected speech were compiled, collected from 14 children with a speech sound disorder (SSD) and two children with typical speech. 16 SLPs and 13 untrained adults participated in a series of ARS listening sessions, where they were fitted with headphones and hand controls, and instructed to click a button whenever they did not understand the child speaking. Listeners' button clicks were registered and, for each speech sample, totaled into an (un)intelligibility index. The proportion of syllables perceived correctly - based on orthographic listener transcripts - was used as a reference score of intelligibility.</p></div><div type="abstract" xml:lang="en"><p><b>RESULTS</b></p><p>The ARS-based intelligibility scores correlated strongly with the intelligibility reference score. Reliability was high across listener groups and weaker for single listeners. No significant difference was found between the evaluations of SLPs and untrained adults.</p></div><div type="abstract" xml:lang="en"><p><b>CONCLUSIONS</b></p><p>ARS-based evaluation offers a valid and reliable measure of intelligibility of particular value in research as a practical tool for collecting input from listeners without experience or knowledge of SSDs. We stress that the ARS design presupposes a listener panel, and that evaluations obtained from individual listeners are predictably inadequate in terms of reliability.</p></div></front></TEI><pubmed><MedlineCitation Status="In-Process" Owner="NLM"><PMID Version="1">32846287</PMID><DateRevised><Year>2020</Year><Month>11</Month><Day>06</Day></DateRevised><Article PubModel="Print-Electronic"><Journal><ISSN IssnType="Electronic">1873-7994</ISSN><JournalIssue CitedMedium="Internet"><Volume>87</Volume><PubDate><MedlineDate>2020 Sep - Oct</MedlineDate></PubDate></JournalIssue><Title>Journal of communication disorders</Title><ISOAbbreviation>J Commun Disord</ISOAbbreviation></Journal><ArticleTitle>Audience Response System-Based Evaluation of Intelligibility of Children's Connected Speech - Validity, Reliability and Listener Differences.</ArticleTitle><Pagination><MedlinePgn>106037</MedlinePgn></Pagination><ELocationID EIdType="pii" ValidYN="Y">S0021-9924(20)30105-2</ELocationID><ELocationID EIdType="doi" ValidYN="Y">10.1016/j.jcomdis.2020.106037</ELocationID><Abstract><AbstractText Label="PURPOSE">We assessed audience response systems (ARS)-based evaluation of intelligibility, with a view to find a valid and reliable intelligibility measure that is accessible to non-trained participants. In addition, we investigated potential listener differences between pediatric speech and language pathologists (SLPs) and untrained adults.</AbstractText><AbstractText Label="METHOD">Sixteen one-minute samples of connected speech were compiled, collected from 14 children with a speech sound disorder (SSD) and two children with typical speech. 16 SLPs and 13 untrained adults participated in a series of ARS listening sessions, where they were fitted with headphones and hand controls, and instructed to click a button whenever they did not understand the child speaking. Listeners' button clicks were registered and, for each speech sample, totaled into an (un)intelligibility index. The proportion of syllables perceived correctly - based on orthographic listener transcripts - was used as a reference score of intelligibility.</AbstractText><AbstractText Label="RESULTS">The ARS-based intelligibility scores correlated strongly with the intelligibility reference score. Reliability was high across listener groups and weaker for single listeners. No significant difference was found between the evaluations of SLPs and untrained adults.</AbstractText><AbstractText Label="CONCLUSIONS">ARS-based evaluation offers a valid and reliable measure of intelligibility of particular value in research as a practical tool for collecting input from listeners without experience or knowledge of SSDs. We stress that the ARS design presupposes a listener panel, and that evaluations obtained from individual listeners are predictably inadequate in terms of reliability.</AbstractText><CopyrightInformation>Copyright © 2020 The Author(s). Published by Elsevier Inc. All rights reserved.</CopyrightInformation></Abstract><AuthorList CompleteYN="Y"><Author ValidYN="Y"><LastName>Strömbergsson</LastName><ForeName>Sofia</ForeName><Initials>S</Initials><AffiliationInfo><Affiliation>Division of Speech and Language Pathology, Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institutet (KI), SE-141 86 Stockholm, Sweden. Electronic address: sofia.strombergsson@ki.se.</Affiliation></AffiliationInfo></Author><Author ValidYN="Y"><LastName>Holm</LastName><ForeName>Katarina</ForeName><Initials>K</Initials><AffiliationInfo><Affiliation>Division of Speech and Language Pathology, Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institutet (KI), SE-141 86 Stockholm, Sweden.</Affiliation></AffiliationInfo></Author><Author ValidYN="Y"><LastName>Edlund</LastName><ForeName>Jens</ForeName><Initials>J</Initials><AffiliationInfo><Affiliation>Speech Music & Hearing/Språkbanken Tal, KTH Royal Institute of Technology, SE-100 44 Stockholm, Sweden.</Affiliation></AffiliationInfo></Author><Author ValidYN="Y"><LastName>Lagerberg</LastName><ForeName>Tove</ForeName><Initials>T</Initials><AffiliationInfo><Affiliation>Institute of Neuroscience and Physiology, Division of Speech and Language Pathology, University of Gothenburg, The Sahlgrenska Academy, Box 452, SE-405 30 Gothenburg, Sweden.</Affiliation></AffiliationInfo></Author><Author ValidYN="Y"><LastName>McAllister</LastName><ForeName>Anita</ForeName><Initials>A</Initials><AffiliationInfo><Affiliation>Division of Speech and Language Pathology, Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institutet (KI), SE-141 86 Stockholm, Sweden; Functional Area Speech and Language Pathology, Karolinska University Hospital, SE-141 86 Stockholm, Sweden.</Affiliation></AffiliationInfo></Author></AuthorList><Language>eng</Language><PublicationTypeList><PublicationType UI="D016428">Journal Article</PublicationType><PublicationType UI="D013485">Research Support, Non-U.S. Gov't</PublicationType></PublicationTypeList><ArticleDate DateType="Electronic"><Year>2020</Year><Month>08</Month><Day>17</Day></ArticleDate></Article><MedlineJournalInfo><Country>United States</Country><MedlineTA>J Commun Disord</MedlineTA><NlmUniqueID>0260316</NlmUniqueID><ISSNLinking>0021-9924</ISSNLinking></MedlineJournalInfo><CitationSubset>IM</CitationSubset><KeywordList Owner="NOTNLM"><Keyword MajorTopicYN="Y">children</Keyword><Keyword MajorTopicYN="Y">intelligibility</Keyword><Keyword MajorTopicYN="Y">perceptual evaluation</Keyword><Keyword MajorTopicYN="Y">speech sound disorder</Keyword></KeywordList></MedlineCitation><PubmedData><History><PubMedPubDate PubStatus="received"><Year>2019</Year><Month>11</Month><Day>18</Day></PubMedPubDate><PubMedPubDate PubStatus="revised"><Year>2020</Year><Month>07</Month><Day>18</Day></PubMedPubDate><PubMedPubDate PubStatus="accepted"><Year>2020</Year><Month>07</Month><Day>23</Day></PubMedPubDate><PubMedPubDate PubStatus="pubmed"><Year>2020</Year><Month>8</Month><Day>28</Day><Hour>6</Hour><Minute>0</Minute></PubMedPubDate><PubMedPubDate PubStatus="medline"><Year>2020</Year><Month>8</Month><Day>28</Day><Hour>6</Hour><Minute>0</Minute></PubMedPubDate><PubMedPubDate PubStatus="entrez"><Year>2020</Year><Month>8</Month><Day>27</Day><Hour>6</Hour><Minute>0</Minute></PubMedPubDate></History><PublicationStatus>ppublish</PublicationStatus><ArticleIdList><ArticleId IdType="pubmed">32846287</ArticleId><ArticleId IdType="pii">S0021-9924(20)30105-2</ArticleId><ArticleId IdType="doi">10.1016/j.jcomdis.2020.106037</ArticleId></ArticleIdList></PubmedData></pubmed><affiliations><list><country><li>Suède</li></country></list><tree><country name="Suède"><noRegion><name sortKey="Strombergsson, Sofia" sort="Strombergsson, Sofia" uniqKey="Strombergsson S" first="Sofia" last="Strömbergsson">Sofia Strömbergsson</name></noRegion><name sortKey="Edlund, Jens" sort="Edlund, Jens" uniqKey="Edlund J" first="Jens" last="Edlund">Jens Edlund</name><name sortKey="Holm, Katarina" sort="Holm, Katarina" uniqKey="Holm K" first="Katarina" last="Holm">Katarina Holm</name><name sortKey="Lagerberg, Tove" sort="Lagerberg, Tove" uniqKey="Lagerberg T" first="Tove" last="Lagerberg">Tove Lagerberg</name><name sortKey="Mcallister, Anita" sort="Mcallister, Anita" uniqKey="Mcallister A" first="Anita" last="Mcallister">Anita Mcallister</name></country></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Sante/explor/SanteMusiqueV1/Data/Main/Exploration
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000075 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 000075 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Sante
|area= SanteMusiqueV1
|flux= Main
|étape= Exploration
|type= RBID
|clé= pubmed:32846287
|texte= Audience Response System-Based Evaluation of Intelligibility of Children's Connected Speech - Validity, Reliability and Listener Differences.
}}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Main/Exploration/RBID.i -Sk "pubmed:32846287" \
| HfdSelect -Kh $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd \
| NlmPubMed2Wicri -a SanteMusiqueV1
| This area was generated with Dilib version V0.6.38. |  |